DeCOHENI RESOHE 



ED 19a 575 TA BOO 70il 

AOTHOR Johnson^ _ Dale D. ; And Others 

TITLE Interim Report: The _ Refinement _ of the lesxBattery to 

Assess Word.Identification Skills, Repbrx from the 
Project on Studies in language: Reading and 
Communication. : 

INSTITUTION Wisconsin Oni v. ^ tladisbh • Research and Development 

Center for Individualized Schooling, 

SPONS AGENCY National Inst, of Education (DHEWI , Washington^ 
_ _ D.C._ 

REPORT NO WRDCIS-TR-5qa 

FOE DATE Jul BO 

GRANT OB-NIE-G-80-0 117 

NOTE BBp. 



EDRS PRICE MFb1/PCdi|_Pius Postage. ^ ^ ^ 

DESCRIPTORS Consonants :_* piagnostic_Tests^ Elementary Education; 

♦ ItecQ Analysis : *Phonics^ 't«Structurai Analysis 
(Linguistics) : Test Construction; Vowels; *Word 

Recognition 

IDENTIFIERS *Word Identification Test (Johnson et ai) 



ABSTRACT 

The research discussed in thisreporx is a 
continuation of an effort to develop, a set of diagnostic subtests in 
phonics and structure with empirically determined mastery levels. The 
complete test will assess the word identification skills of 
ileDuehta ty school children. Reviiichs made_in the test _ battery 
following _ administration: of the Phdnicsahd Structure Subtests are_ 
documented, A study in which the revised siibteits were administered 
to_B0 grade 2 and 3 pupils is also described. Item analysis 
information for use in the preparation of the subtests for the final 
administration of the Word Identification Test battery is presented. 
These revisions will Intprcve the diagnostic precision cf the tests 
and eliminate concerns regarding correct response position and 
frequency of occurrence of specific distractor categories. Results of 
evaluating the grade level a pprcpriate ne each sub-cesz indicated: 

(1)^ the Phonics Subtests could be administered to younger children 
/grade 1) : _and (2) the Structure Subtests could be administered to 
older children (grades ^4 and 5 for affixes^ and grade ^ for 
possessives and contractions) . (Author/RL) 



* Reproductions supplied by EDRS are the best that can be made * 
* from the prigina 1 (ipcument * 




ERIC 



Technical Report No. 544 



INTERIM REPORT: THE REFINEMENT OF THE TEST BATTERY 
TO ASSESS WORD IDENTIFICATION SKILLS 



by 

Dale D. Johnson, Susan D. Pitteimen 
Judy Schwenker and Linda F. Shriberg 



i 

Report from the Project on 

Studies in Language: Reading and Coinraunication 



Dale D. Johnson 
Faculty Associate 



Wisconsin Research and Deyeldptnent Center 
for Individualized Schooling 
The University of Wisconsin 
Madison, Wisconsin 

July 1980 



SL^«;"™KS-;ri1 --:-"utf„ S'^H;, ""S" 



of Education shoulu bu inferred. 

Center Grant No. on-NIE-G-.80-0117 



ii 



4 



MISSION STATEMENT 



The mi Sis ion of the? Wiscorusin Kg search and Deveiopmc^nt. Center 
is to improve the quality of education by v^ddresjiinq tnc full 
range of isfjugs and problems related to individualized school inq. 
Teaching, learning, andthe problems of individualization are 
given concurrent attention in the Center's efforts to discover 
processes and develop strategies and matc?r ials; for ur.o in the 
schools. The Center pursues its mis.sion by 

• conducting and synthesizing rt-search tc^ clarify th<* 
firoces.ses of J;chool-age childrr^n's lecirning .nid 
development 

• conducting and synthesizing research to clar i f y of f ective 
approaches to teaching students basic skills and concepts 

• developing and demonstrating improved instructional strategies, 
processes, and materials for students, teacl\ers, and school 
administrators 

• providing assistance to educators which helps transfer the 
outcomes of research arid development to improved practice 
in loca 1 schools arid teacher education institutions 

The Wiscbrisin Research and Development Center is supported 
With funds from the National Institute of Education and the 
University of Wisconsin. 



WISGOtiSlN RESEARCB AND DEVELOPMENT 
CENTER FOR INDIVIDUALIZED SCHOOLING 



ACKNOWLEDGMENTS 



The authors gratefully acknowledge the cooperation of the pupils and 
teachers at Belleville Elementary School in Belleville, Wisconsin. Their 
support of cind participation in this research is greatly appreciated. 

The authors also acknowledge with gratitude Lawrence D. Shriberg, 
Professor of Speech Pathology , University of Wisconsin -Madison; Dominic W, 
MassarOr Professor of Psychology , University of Wisconsin-Madison; Peter A. 
Schreiber, Professor of English and Linguistics, University of Wisconsin- 
Madison; and Richard L. Venezky^ Unidel Professor of Educational Founda- 
tions, University of Delaware, for their helpful suggestions. 



iv 



6 



TABLE OF CONTENTS 

Page 

Aciaiowledgments iv 

List of Tables vii 



tist of Figures ix 



Abstract .............. xii 

Development of the Structural Analysis Subtests . 5 

Method , , . . 5 

Subjects 5 

Stimuli ..... 5 

Inflected Endings Subtest . . 5 

Contractions S Possessiives Subtest 9 

Affixes Subtest 16 

Procedure ......... .... 21 

Results ............. 21 

Structure Subtests ........... 21 

Inflected Endings Subtest _ ............... 24 

Contractions s Possessives Subtest ........... 28 

Affixes Subtest .................... 28 



Development of the Phonics Subtest ............... 33 

Method 33 

Subjects 33 

Procedure ..^ 33 

Cor? sonants Subtest . 34 

Vowels Subtest ...... 35 

Stimuli-.-. 35 

Consonants -Subtest ...... 35 

Selection of Target Sounds ... 38 

Selection of Response Choices ... 39 

Correct Response- Choice ...... 43 

Visually Close Response Choice ..... 43 

Acoustically Close Response Choice ........ 44 

"Neither" Response Choice ............ 46 

Vowels Subtest 48 

Selection of Target Sounds ............. 51 

Selection of Response Choices ............ 55 

Correct Response Choice 55 

Visually Close Response Choice 55 



V 

7 



TABLE OF CONTENTS (continued) 



Page 

Acoustically Close Response Choice ........ 58 

"Neither" Response Choice ............ 59 

Results ........................... 60 

Consonants Subtest .................... 60 

Vo we Is S ub t e st ...................... 62 



Preparation of the Final Version of the Word Identification 

Test Battery 65 

Structure Subtests . 65 

Inflected Endings Subtest . . 65 

Contractions & Possessives Subtest 66 

Affixes Subtest ...... 67 

Phonics subtests ........... 67 

Consonants Subtest .................... 67 

Vowels Subtest ...................... 69 

conclusions ........................... 7i 

Reference Notes 73 

References ........................... 75 



8 

vi 



LIST OF TABLES 



I^iS: Page 
± Structural Analysis Subjects by Grade ... 6 

2 Target_ Inflected Endings Assessed in Winter 78/79 and 

, Winter 79/80 Versions of the Inflected Endings Subtest . 8 
« ----- 

3 Frequency of Contractions and Rank Order and Number of 

Test Items per Contraction Category 13 

4 Target Forms in Winter 79/80 Contractions & Possess ives 

Subtest ........... 14 

5 Comparison of Target Affixes Between Spring 1979 and 

Winter 79/80 Subtests ............. 17 

6 Summary Statistics for the Structure Subtests ....... 23 

7 summary of 1:-Tests for Differences Due to Sex ....... 25 

8 Summary of t-Tests for Differences Due to Grade Level . , , 26 

9 Description of Reading Groups and Summary of t-Tests by 

Subtest • . . . ^ ^ ^ ^ ^ ^ 27 

10 Rank-ordered Listing of Mean Percent Correct on Inflected 

Endings Item Categories 29 

11 ^5^:^?'^®^®^_^i?ting of Mean Percei)t /;crrect on Contrac- 

tions Bi Possessives Categories 30 

12 Rank -ordered Listing of Mean Percent Correct on Affixes 

Categories .............. 32 

13 Target Correspondences in Consonants Subtest by Frequency 

and Position ...................... 4o 

14 Categories for Determining Acoustically Close Response 

Choices for Consonant Clusters ............. 47 

15 Target Correspondences for Short, Long^ and '*Other" 

Single-letter Vbwels by Frequency and Position ..... 53 

16 Target Correspondences for Vowel Clusters by Frequency 

and Position 56 

vii 

' 9 

o 

ERIC^ 



LIST OF TABLES (continued) 

Tab^Le^ Page 

17 Summary Statistics for Phonics Subtests .......... 61 

18 Rank -ordered Listing of Mean Percent Correct Scores by 

Consonant Category ................... 63 

19 Rank -ordered Listing of Mean Percent Correct Scores by 

Vowel Category ..................... 64 



10 



viii 



LIST OF FIGURES 



F-igure- Page 

1 Directions arid practice items from the first page of 

the Inflected Endings Subtest . . ; 10 

2 Directions and practice items from the first page of 

the Contractions & Pbssessives Subtest 15 

3 ^^^^^tions and practice items from the first page of 

the Affixes Subtest 22 

4 Directions and practice items from the first page of 

the Consonants Subtest for Initial Position 37 

5 Directions and Practice items from the first page of 

the Vowels SuiDtest for Medial Position 50 



ik 

11 



ABSTRACT 



The research discussed in this report is a continuation of an effort 
to develop a set of diagnostic stibtests in phonics and structure with 
empirically determined mastery levels which will assess the word identi- 
fication skills of elementary school children. 

In spring 1977, a prototype of the test battery was developed and 
pilot tested on 282 pupils. Between winter 1977 and spring 1979, the 
subtests were administered to approximately 1700 elementary school students 
from five regions of the country. This report documents the revisions 
made in the test battery following a winter 78/79 and spring 1979 admin- 
istration of the Phonics and Structure Subtests, The report also des- 
cribes a istudy in which the revised subtests were administered to 80 
second and third grade pupils. 

The primary purpose of this study was to obtain item analysis in- 
formation for use in the preparation of the subtests for the final ad- 
ministration of the Word Identification Test battery, which was conducted 
in spring 1980. While only minor revisions were necessary, these revi- 
sions should improve the diagnostic precision of the tests and eliminate 
concerns regarding correct response position and frequency of occurrence 
of specific distractor categories. 

Another purpose of the present study was to evaluate the grade level 
appropriateness of each subtest. Results indicated (a) the Phonics Sub- 
tests could be administered to younger children (first grade) , and (b) the 
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structure Subtests could be administered to older children (fourth and 
fifth grade for Affixes, and fourth grade for Possessives & Contractions), 

This report is the fourth report in a series of five; The final 
report in the series, which will be available in fall 1980, will mark the 
conclusion of the research conducted over the past three and a half years 
by the Project on the Assessment and Analysis on Word Identification Skills 
in Reading; 
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The work reported in this paper is a continuation of a research 
effort begun in spring 1977 by the Project on Assessment and ftnaiysis of 
Word Identification Skills in Reading. The focus of the research over 
the last three years has been (a) to identify those word identification 
skills which appear to relate most closely to the comprehension of written 
language; and (b) to empirically determine mastery levels for each word 
identification subtest based on performance of groups of subjects strati- 
fied by comprehension ability. 

The ultimate goal of the research is the development of a set of 
diagnostic subtests with empirically determined mastery levels, which 
will assess the word identification skills of elementary school children. 
The test battery consists of five stibtests within two major skill areas: 
phonics and structural analysis. The Word identification Test battery, 
with mastery levels set by comprehension standards rather than by an 
arbitrary cutoff score (such as 80%) , is intended to assist teachers 
in making sound instructional decisions based on the accurate assessment of 
word identification skills . 

In spring 1977, a prototype of the test battery was developed which 
assessed skills in three broad areas of word identification: phonics, 
structure, and context. In order to provide baseline information, the 
battery also included a section assessing reading readiness; skills, the 
prototypes were pilot tested on a total of 282 pupils in grades brie, 
three > and five. Following the data analysis, revisions were made on the 
individual subtests (Johnson, Pitteiman, Schwenker, Shriberg, & Morgan- 
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Janty, 1978). In winter 1977 and spring 1978, the revised Word Identi- 
fication Test battery (assessing skills in the areas of phonics, struc- 
ture and contextual analysis) and the reading subtest of the Metropolitan 
Achievement Tests (Farr, Prescott, Balow, & Hogan, 1978) were administered 
to approximately 1150 second, fourth, and sixth grade public elementary 
school children from five regions of the United States (Johnson et al. , 
1978). Following analysis of the data from these test administrations, 
the criteria v^ich guided test construction were evaluated, and additional 
criteria were incorporated in the development of the present tests (Jchnson, 
Pittelman, Schwenker, & Shriberg, 1979; Johnson, Shriberg, Pittelman, & 
Schwenker, 1979). Furthermore, a decision was made to limit the develop- 
ment of the Word Identification Test battery to the areas of phonics (with 
Consonants and Vowels Subtests) and structural analysis (with Inflected 
Endings and Affixes Subtests). 

In winter 78/79, the revised Inflected Endings Subtest was administered 
to 143 third and fourth graders, and the revised Consonants Subtest was 
administer.e^d to 187 third through fifth graders. In spring 1979, the re- 
vised Affixes Subtest was administered to 257 fourth and fifth graders and 
the revised Vowels Subtest was administered to 190 third through fifth 
graders (Johnson, Pittelman, Schwenker, & Shriberg, 1979; Johnson, Shriberg, 
Pittelman, & Schwenker, 1979). 

This report documents the revisions made in the Phonics and Structural 
Analysis Subtests following the winter 78/79 and spring 1979 administration 
of the Phonics and Structure Subtests, and also describes a study in which 
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the revised subtests were administered to 80 second and third grade pupils. 
The primary purposes of the study conducted in fall and winter 79/80 were 
to obtain item analysis information prior to preparation of the final 
version of the tests and to evaluate the test directions and administrator's 
manual for each subtest. 

In spring 1980^ the final version of the Word Identification Test 
battery was administered to approximately 600 first through fifth grade 

..... w 

elementary school students. The performance data will be used to examine 
correlations between reading subskiiis, as measured by the various sub- 
tests in the Word Identification Test battery, and global comprehension 
ability^ as measured by a standardized reading test. In addition, the 
data collected in spring 1980 will be used to establish empirically based 
levels of skills mastery for each of the reading subskills assessed in 
the battery. Results of the above analysis will form the basis of the 
final Project monograph which will be published in fall 1980. 
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DEVELOPMENT OF THE STRUCTURAL ANALYSIS SUBTESTS 



The structural analysis component of the Word identification Test 
battery assesses students' skills in the areas of inflected endings, con- 
tractions and possessives, and affixes. 

Method 

SUBJECTS 

A total of 80 second and third grade pupils from Belleville Elementary 
School participated in the study to evaluate the three structure subtests 
(see Table 1). Belleville, Wisconsin is a rural community approximately 
30 miles from Madison. All four classrooms participating in the study were 
heterogeneously grouped. 

STIMULI 

The structural analysis component of the Word Identification Test 
battery is comprised of three subtests: revised versions of the Inflected 
Endings and Affixes Subtests and the newly created Contractions & Posses- 
sives Subtest. 

Inflected Endings Subtest 

A 39-item test of inflected endings was developed. Seven different 
target inflected endings were assessed by the revised subtest compared to 
eight assessed in the winter 78/79 version. The target inflected endings 
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Table 1 

Structural Analysis Subjects by Grade 
(N = 80) 



Grade 2 Grade 3 



Classroom ft 


21 




Classroom B 


22 




Classroom C 




19 


Classroom D 




18 




Total per grade 


43 


37 



18 
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assessed in each version r as well as the number of items for each target 
inflected ending, are presented in Table 2, 

Analysiis of the data frbin the winter 78/79 administration of the In- 
flected Endings Subtest to fourth and fifth grade students had shown a 
marked ceiling effect. Performance on items involving the possessive use 
of the apostrophe, however, showed significantly lower scores. Because of 
this inconsistency, a decision was made to delete ^ and s' words both as 
items and as incorrect response choices from the Inflected Endings Subtest 
and to develop a separate subtest which would assess possessives and con- 
tractions as alternative uses of the apostrophe. 

The elimination of words containing the 's and s' led to a second 
change in the Inflected Endings Subtest. Because ^ and s_|_ endings had 
been frequently used as incorrect response choices in the subtest, and 
because many of the rpot- words in the test had too few inflected forms to 
generate replacement incorrect response choices , new root words had to be 
selected for 30% of the items. 

Another cons iderat ion, the length of the item sterns^ led to a third 
type of revision in the Inflected Kndings Subtest. These revisions were 
aimed at easing the reading load of the Inflected Endings Subtest by 
shortening sentences whenever possible while still retaining adequate 
context for the correct response. Sentence shortening would serve to 
make the subtest more appropriate for second and third grade students, the 
intended target population. 

The format for the revised Inflected Endings Subtest remained similar 
to the format of the previous version of the test: Pup>ils saw a sentence 
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Table 2 

Target inflected Endings Assessed in 
Winter 78/79 and Winter 79/80 Versions of the 
Inflected Endings Subtest 



Target Inflected Ending 



NiJinber of Items 



Winter 78/79 



Winter 79/80 



s (plural) 
(e)s (verb) 
(i)ed 
ing 

's or s' 
(i)es 
er 
est 

y 



6 
5 
5 
5 
4 
3 
3 
3 



5 
6 
6 
3 



3 
3 
1 



Other Target Words 



tense marker (with 
vowel change) 

root (correct response) 



11 



Total Number of items 



43 



39 



20 



with a word missing and were instructed to select the response choice (pro- 
vided beiow the sentence) that best completed the sentence. However, a 
fourth response choice, none of these^ , was added to the revised test to 
increase its reliability. The revised Inflected Endings subtest, there- 
fore, contains four response choices for each item. Response choices con- 
sisted of root words, root words plus inflected endings, and the response 
choice none of these . Figure 1 is a copy of the directions and practice 
items from the revised Inflected Endings Subtest; 

Contractions & Possessives Subtest 

A 31-item test was developed for the current study to assess children's 
knowledge of contractions and possessives. (in the previous test battery, 
contractions were not assessed and possessives items were incorporated in 
the Inflected Endings Subtest.) The rationale for assessing both contrac- 
tions and possessives in the same test is that both constructions use the 
apostrophe, although to convey different meanings. The ability to dis- 
tinguish between these two uses of the apostrophe is important for obtaining 
the intended meaning of connected text which, in turn^ affects comprehension. 
Consider, for example, the following two sentences: 

George ^ lead part in the school play made Tom jealous. 

(Possessive form) 

George ' s lead actor and Tom's assistant director in the 

school play. (contracted form) 
To comprehend, a reader must be able to distinguish between the different 
meanings of the apostrophe in the word George ' s in these two seemingly 
similar sentences. 



Inflected Endings 



Bacii oT the sentences below has a word missing. Read each sentence. 
Then carefully read each_of the Words below the sentence. Draw a circle 
around the word that best completes the sentence. Sometimes, *Vnone of 
tiiese** may be the best answer, because a cbrrect word is not given. 



A. 


iier piece of 


cake is than mine. 










big 


biggest bigger 


none 


of 


these 


B. 


Doctors were 


at the hospital . 










need 


needed needing 


hone 


of 


these 


C. 


The puppy 


out o£ the box . 










jump 


jumper jumping 


none 


of 


these 



Figure 1. Directions arid practice items from the first page of the 
Inflected Endings Subtest. 
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The first step in constructing the Contractions & Possessives iSubtest 
was to conduct a survey of basal materials, identifying the contractions 
typically taught to second, third, and fourth grade students, and the for- 
mats used to teach and test these contractions. The four widely used basal 
series selected for review were: Ginn 720 (Clymer et al., 1978 Rainbow 
Edition), Heath and Company (Witty, Bebeii, S Freeland, 1968 Edition), 
American Book Company (Johnson et al., 1968 Edition), and Houghton Mifflin 
(Durr et al., 1974-78 Edition). A skills management system, the Wisconsin 
Design for Reading Skill Development (Otto et al., 1972, 1975), was also 
reviewed. The review of these materials revealed that many contractions 
are taught by the end of the second grade, and that all of the common con- 
tractions receive instructional attention by the end of third grade. 

The second step in developing the Contractions & Possessives Subtest 
was to select the contractions to test and decide the number of items 
needed to assess each target contraction. As with the other two structure 
subtests, the number of target items for each contraction was based on 
frequency information. First, the contractions were grouped into categories 
based on which member of the word pair was contracted. For example, con- 
tractions of will , such as I'll , we'll , he'll , and they ' 11 formed one con- 
traction category. Then, The T^erican Heritage Word Frequency-Book* ^ 



_-_ _:_^his_book is_a word list based on the examinatidri of published material 
for children in third through ninth grade, and contains 5,088,721 tokens and 
86,741 words ^ver 5 million words of running text were extracted for analy- 
sis from 1/045 different publications, with a total of 90 schools participat- 
ing in the study; Table 3 Presents the results of the analysis of the 600 
most frequent words for the presence of target inflected endings. 
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(Carroll, Davies , & Richmari, 1971) was used to determine the frequencies of 
each of the specific contracted fdrrtis within this categories. Basisd on these 
frequency tabulations, the contraction categories were rank-ordered arid a 
proportional number of specific contracted forms were selected for asisess- 
ment in the new subtest. This category and frequency information is 
summarized in Table 3, 

In addition to 21 items assessing contractions, 10 items were created 
to assess possessives for a total of 31 items on the Contractions S Posses- 
sives Subtest. The target possessive and contracted forms assessed in the 
subtest, as well as the number of items for each form, are presented in 
Table 4. 

The format of the Contractions & Possessives Subtest required that 
pupils read a sentence which contained an underlined contracted or posses- 
sive word, and then circle the response choice (from four possible responses 
provided below the sentence) that best described the meaning of the under- 
lined word in the sentence. Sentences for each item were brief and similar 
in vocabulary level to minimize variation in pisrfdrinance due to differences 
in pupils' vocabulary knowledge. Figure 2 is a copy of the directions and 
practice items from the Contractions & Possessives Subtest. 

fts mentioned above , there were four response choices for each item. 
The response choices for items varied, depending on whether the item 
assessed a contracted form not ending in apostrophe s_ (such as they ' y e ) , 
a contracted form ending in apostrophe s^ (such as what ' s) , or a possessive 
form ending in apostrophe s (such as Tony ' s ) . 
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Table 3 

Frequency of Contractions^ and Rank Order and 
Number of Test Items per Contraction Category 



Contraction 


Contraction 
frequency 


Rank order 
by category 


Nximber of test items 
by category 


aren ' t 
doesn ' t 
hash ' t 
shouldn ' t 
weren' t 
Won ' t 


239 
590 
98 
90 
176 
756 


1 


6 


it's 
here ' s 
what ' s 


2,178 
118 
482 


2 


3 


it'll 

they'll 

you'll 


65 
120 
524 


3 


3 


they ' ve 
you ' ve 


CO 

317 


H 


2 


I'd (had) 
we'd (had) 


534 
not listed 


5 


2 


she'd (would) 
it'd (would) 


130 
11 


6 


2 


I'm 


1,848 


7 


1 


let's 


892 


8 


± 


you • re 


848 


9 


1 


; . : 

American Heritage Word Frequency Book. ^ 



Table 4 

Target Forms in Winter 79/80 
Contractions & Possessives Subtest 



Target Forms Occurrences 



n't 


(not) 


6 


'11 


(will) 


3 


'd 


(would) 


2 


•ve 


(have) 


2 


•d 


(had) 


2 


•nt 


(am) 


1 


•s 


(us) 


1 


•re 


(are) 


i 


•s 


(is) 


3 


•s 


(possessives) 


10 


Total 




31 



26 
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Contractions and Possessives 



Read each sentence below carefully. Then decide which meaning the 
apostrophe mark ( * ) has in the underlined word. Circle the choice given 
below the sentence that tells the meaning of the underlined word. In 
some cases, "none of these'/ may be the correct answer because the real 
meaning. oT the apostrophe in the underlined word is not given. 



The cuckoo c lock' s been broken for a long time. 

possessive ' clock is clock has none of these 



There wash' t any question that Andy was the best runner, 
possessive ' was none was no none of these 



The wind.1^ energy is used by windmills to raise water, 
possessive * wind has wind is none of these 



Figure 2. Directions and practice items from the first page of the 
Contractions St Possessives Subtest. 



27 

o 

ERIC 



16 



The four response choices for all the items which assess a contracted 
form not ending in apostrophe s_ consisted of the correct response choice, 
two response choices consisting of two-word combinations which could make 
sense in the context of the sentence but did not correspond to the con- 
tracted form, and the phrase none of these . Thus, if the target contracted 
form was they ' ve , the incorrect response choices might be "they did," "they 
gave , " and the phrase none of -these . 

The formation of response choices for target words ending in apostrophe 
s- was the same regardless of whether tho apostrophe s_ represented a posses- 
sive or a contraction. The four response choices included the word posses- 
sive ' , two response choices consisting of one word of the two-word phrase 
which comprised the target contracted form, and the phrase none of these . 
For example, for the target word what' s , the response choices were (1) pos- 
sessive ' , (2) what has , (3) what is , and (4) none of these . For the target 
word Jan ' s , the response choices were (1) possessive ' , (2) Jan has , (3) Jan 
was , and (4) none of these . The only exception in the formation of the 
response choices was. when the phrase none of these was the correct answer. 

Affixes Subtest 

A 54-item subtest was developed to assess students' knowledge of 
affixed words. A total of 18 target affixes was assessed in the revised 
subtest, compared to 20 assessed in the previous version. The target 
affixes that were selected for the subtest, as well as the number of items 
for each type of affix, are presented in Table 5, 
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Table 5 

Comparison of Target Affixes Between 
Spring 1979. and Winter 79/80 Subtests 



Spring 1979 Winter 79/80 

NumlDer of Number of 

Target Affixes Test items Test items 



dis- 


4 


3 


in-/im- 


4 


3 


inter- 


4 


3 


non- 


4 


3 


pre- 


4 


3 


re- 


4 


3 


sub- 


4 


3 


un- 


4 


3 


-able/-ible 


4 


3 


-ance/-ence 


4 




-ant/ -en t 


4 




-en 


4 


3 


-er/-or 


4 


3 


-fui 


4 


3 


-ibn/-tion/-sion 


4 


3 


-less 


4 


3 


-ly 


4 


3 


-ment 


4 


3 


-ness 


4 


3 


-ous 


4 


3 



Total 80 54 



29 



18 



Analysis of the data from the previous administration of the Affixes 
Subtest had raised several issues regarding the design of the test items 
and the length of the subtest. These concerns resulted in four kinds of 
revisions on the Affixes Subtest. 

The first type of revision concerned the selection of root words used 

in assessing the 18 target affixes. The previous version of the subtest 

2 - 

included several root words containing bound bases. There was some concern 
that words with bound bases might confound the assessment of children's 
knowledge of the affixed element. Therefore, despite the high frequency 
of affixed words containing bound bases in the English language, it was 
decided that the number of root words with bound basiss in the revised 
Affixes Subtest would be limited. When words containing bound bases are 
used in the revised subtest, the bound form of the word occurs in ail four 
response choices. For example, in the item with the root word collect , 
which contains the bound base lect , the response choices are all exten- 
sions of the word collect (i.e., collection , recollect , collector , collect- 
ible ) . Lecture or elect do not qualify as response choices. Similarly, 
in the item using the root word invent , which contains the bound base vent , 
ail response choices include invent; thus prevent does not qualify as a 
distractor. 

The second area of revisions focused on the vocabulary level of the 
root words and their corresponding affixed forms. Elementary school 



A bound base is a linguistic element, rather than an independent, 
meaningful word. An example of a bound base is the element lect as in 
the words collect and lecture . Approximately half of all suffixes and 
73% of all prefixes attach to bound bases. 
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children's familiarity with each root and affixed word in the previous 
version of the Affixes Subtest was determined from information in The 
Living Word Vocabulary (Dale & O'Rourke, 1976).^ For mcuiy items in the 
subtest/ the root word was familiar to students at a particular grade 
level/ but the affixed forms of the same root word were not. For example/ 
the root word act, is listed in The Living- Word- Vocabulary as being familiar 
to a majority of second/ third/ and fourth grade pupils. Yet several of 
the response choices/ affixed forms of the root word act such as inactive 
or activated/ are familiar only to pupils at the eighth grade level and 
above. To minimize the variations in familiarity ratings between a root 
word and its affixed forms / response choices were selected that had 
vocabulary levels as consistent as possible both within and across test 
items. Root words from the previous version of the subtest which did not 
yield affixed forms familiar to second > third/ and fourth grade pupils 
were replaced with root words whose affixed forms are well known by 
students at these griade levels. 

A third area of concern regarding the previous version of the Affixes 
Subtest was the variation in spelling between certain iriDbt words arid their 
affixed forms. For example/ in the previous subtest/ the root word day is 
changed to daily when the suffix ^ly is added. To minimize the effect of 
such alterations in spelling/ the revised version of the Affixes Subtest 
uses the complete affixed forms of the root word as response choices 
rather than the isolated affixes used in the previous version. The 



The Living Word Vocabulary lists 43/000 words and their percentage 
scores based on how familiar the words are to students in grades 4, 6/ 8/ 
10/ 12/ 13/ and 16. 
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affixed portions of each response choice are also underlined in the re- 
vised subtest to help students focus their attention on the affixed com- 
ponent. Furthermore r the base or root word for each item is shown be- 
neath the item number and is set off in a box for easy recognition- 

Finally, a decision was made to shorten the Affixes Subtest by delet- 
ing one item from each of the 20 affix categories and to eliminate two 
of the target affixes , -^ant/^ent and ^ance/-ence . Performance had been 
lower on these two affixes than on the other affixes assessed in this pre- 
vious version. Moreover, these two affixes created problems in item con- 
struction because their affixed forms occur mainly in words rated far 
above the appropriate vocabulary level for the subtest. The present ver- 
sion of the Affixes Subtest consists of only 54 items, and requires a 
shorter administration time. This adjustment in length helps to mcike 
the Affixes Subtest more appropriate for second and third grade students - 

The format for the revised Affixes Subtest is similar, but not 
identical, to the format of the previous version. In both tests , pupils 
read a prose description of the affixed word and were instructed to circle 
the response choice (from four response choices provided below the descrip- 
tion) defined in the stem. In the revised subtest, however, the stems are 
shortened and the root word is shown beneath each item number. The re- 
sponse choices for the revised siibtest include the correct response affixed 
word and three other affixed forms of the same root word which do not fit 
the description or definition given in the item stem. In the previous 
version of the subtest, response choices consisted of only the isolated 
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affixes. Figure 3 is a copy of the directions cind practice items from 
the current Affixes Subtest. 

PROCEDURE 

Each classroom of children received ail three Structure Subtests: 
Inflected Endings, Contractions & Possessives, and Affixes; The inflected 
Endings Subtest was given first. Administration time for the Inflected 
Endings Subtest (including directions and practice items) was approximately 
25 minutes for second grade students and 15 minutes for third grade students. 
After a 30-minute break for recess, the Contractions & Possessives Subtest 
was administered; this subtest (including directions and practice items) 
took approximately 38 minutes for second grade students arid 35 minutes for 
third grade students. Total administration time for the Affixes Subtest, 
the last subtest given, was approximately 33 minutes for second grade 
students and 25 minutes for third grade students. 

Ail tests were administered by staff members of the Wisconsin Re- 
search and Development Center for individualized Schooling with the 
assistance of one additional person hired by the Project to aid with test 
administration. Testing was conducted one morning in December 1979. 



Results 



STRUCTURE SUBTESTS 



Summary statistics for the 80 secorid arid third grade students on 



the Structure Subtests (Iriflected Endings, Contractions & Possessives, 



and Affixes) are presented in Table 6. 



t 
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Affixes 



Look at each row and read the word in the small box. This word is the 
root or base word for the sentence. Now read the sentence. Below the 
sentence are Four answers, each cbnta ining the root word plus another 
word part or parts. Draw a circle around the word that is described or 
defined in the sentence. 



A. 

happy 



A word that describes a person who is not happy: 

unhappy happi est happil_y unhappi ness 



B. 
sweet 



C. 

drive 



A word that means the quality of being sweet: 
unsweetened sweetness sweeter 



sweetest 



A word that describes a car that can not be driven: 
driving drivar_ dr iv able undr iv able 



Figure 3. Directions and practice items from the first page of the 
Affixes Subtest. 
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Table 6 

Summary Statisticis for the 
Structure Subtests 
= 80) 



X Range 
Number of percent (percent 
Subtest items correct S.D. correct) 



Inflected Endings 39 79.23 18.31 23.08 - 97.44 
Contractions & 

31 58.95 20.65 19.35 - 96.77 

Possessives 

Affixes 53 48.61 22.13 0.00 - 90.57 
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The large variance in mean scores between the three subtests led to 
certain conclusions regarding the grade level appropriateness of these 
subtests. This issue is discussed in the concluding section of this re- 
port. 

Data from the three Structure Subtests were also used in t_-tests for 
significant differences in performance due to sex and grade level. Sum- 
mary information dri the t-tests for sex and grade level differences is 
presented in Tables 7 and 8, respectively. 

Because percentile scores from a standardized reading test were 
made available by the participating school, another analysis was performed 
on the Structure Subtests data; The total sample was stratified into high, 
medium, and low reading groups based on subjects' percentile scores on the 
standardized reading tests. T-tests were used to examine betweeh-group 
differences on each structure subtest and on the structure component as a 
whole. Summary information from this analysis is presented in Table 9. 

Students' performance on each of the three Structure Subtests was also 
excimined by item categories within each subtest. This information, as well 
as reliability estimates for each subtest, is presented below. 

Inflected Endings Subtest 

Of the 39 items on the Inflected Endings Subtest, students obtained 
a mean score of 30.89 (79.23%) correct. In order to identify items on 
which students performed poorly, and to obtain an estimate of the reli- 
ability of the Inflected Endings Subtest as a whole, the raw score data 
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Table 7 

Summary of _t-Tests for Differences 
Due to Sex 
(N = 80; df_ = 78) 



t -value 



Probability 



Inflected Endings 
Boys 
Girls 



42 
38 



.75 
.84 



2.11 



.038 



Contractions & 
Possessives 



Boys 
Girls 



42 
38 



.55 
.64 



1.94 



.056 



Affixes 
Boys 
Girls 



42 
38 



.47 
.51 



.72 



.47 



Total Test 
Boys 
Girls 



42 
38 



.58 
.64 



1.58 



.118 



37 



26 



Table 8 

Smtimary of Jb-Tests for Differences 
Due to Grade Level 
(N = 80; df = 78) 



t -value 



Probability 



Inflected Endings 
Grade 2 
Grade 3 



43 
37 



;73 
.87 



3-83 



.000 



Contractions £i 
Posse ssives 

Grade 2 

Grade 3 



43 
37 



.54 
.65 



2.53 



.013 



Affixes 
Grade 2 
Grade 3 



43 
37 



.39 
.59 



4.49 



,000 



Total Test 
Grade 2 
Grade 3 



43 
37 



.53 

;69 



4.31 



.000 



38 
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Table 9 

Description of Reading Groups cind Summary of 
t-Tests by Subtest 



N 

X 



tow 

d-33 percentile 



Medium 
34-79 percentile 



High 
80-99 percentile 



13 



45 



22 



.4753 

.112 

.031 



.5799 

.182 

.027 



.7483 

.132 

.028 



Comparisons 



Iiow-Mediuiti 
(df = 56) 



Medium-High 
(df = 65) 



Low-High 
(df = 33) 



^-value Probability t-value Probability t.-value Probability 



Inflected Endings 

Contractions St 
Possessives 

Affixes 



1.55 
2.23 
1.60 



.126 
.030 
.116 



3.38 
3.63 
3.24 



.001 
;001 
.002 



4.85 
6.25 
4.43 



.000 
.000 
.000 



Total Test 



1.96 



.055 



3.86 



.000 



6*25 



.000 



33 
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were subjected to an item analysis. The resultant Hoyt reliability estimate 
for the subtest was .91 with a standard error of measurement of 2.06. 

ft rank -ordered listing of students' performance on each inflected end- 
ing category is presented in Table 10. The mean percent correct on these 
categories ranged from 90.8% (for the ing ending) to 51.2% (for the item 
assessing "kept") . 

Contractions & Possess ives Subtest 

Students obtained a mean score of 18.27 (58,95%) correct on the 31 items 
on the Contractions s Possess ives Subtest. In order to identify items on 
which students performed poorly and to obtain an estimate of the reliability 
of the subtest f the raw score data were subjected to an item analysis. The 
resultant Hoyt reliability estimate for the subtest was .88 with a standard 
error of measurement of 2-16. 

A rank -ordered listing of students' performance on each of the contrac- 
tion categories and on the posssessive apostrophe category is presented in 
Table 11. Mean percent correct on these categories ranged from 90.0% (for 
the contraction am) to 36.7% (for the possessive apostrophe category) . 

Aff4xes Subtest 

Of the 53 items on the Affixes Subtest, students obtained a mean score 
of 25.76 (48.61%) correct. In order to identify items on which students 
performed poorly and to obtain an estimate of the reliability of the Affixes 
Subtest, the raw scoro data were subjected to an item analysis. The result- 
ant Hoyt reliability estimate for the subtest was .93 with a standard error 
of measurement of 3.11. 
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Table 10 



Rank -ordered Listing of Mean Percent Correct 



on inflected Endings Item Categories 



Category Number of Items Mean Percent Correct 

ing 3 90.8 
root word 

(as correct 11 85.7 
resiponse) 

er 3 80.8 

es 6 79.9 

est 3 79.9 

"y 1 77.5 

(i)ed 6 73.2 



"kept" 

(tense rker 
with vowoi 
change) 



51.2 



41 
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Table ii 

Rank-Ordered listing of Mean Percent Correct 
on Contractions & Possess ives Categories 



Category Number of items Mean Percent Correct 



am 




1 


90.0 


is 




3 


81.7 


are 




1 


81.3 


us 




1 


78.7 


riot 




6 


69.3 


Will 




3 


65.4 


have 




2 


63. 7 


had 




2 


58.1 


would 




2 


54.4 


Possessive 
apostrophe 




10 


36.7 



42 



31 



A rank-ordered listing of the affix categories is presented in Table 12. 
Mean percent correct on thece categories ranged from 67.1% (for the -.ful 
category) to 27.9% (for the ~ (t) ion category) , 
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Table 12 

Rcuak -ordered Listing of Mean Percent 
Correct on Affixes Categories 



Category Number of Items Mean Percent Correct 



Prefixes : (23) 

re- 3 62.1 

non- 3 53.7 

dis- 3 52.0 

un- 2* 48.1 

in-/im- 3 43.7 

sub- 3 37.1 

inter- 3 32.4 

pre- 3 31.2 

Suffixes : (30) 

-ful 3 67.1 

-br/-er 3 58.3 

-less 3 55.0 

-able/-ible 3 53.7 

-ment 3 52.9 

-ly 3 50.8 

-(i)ous 3 50.4 

-en 3 47.4 

-ness 3 47.1 

-(t)ion 3 27.9 



Note : One item assessing uh- was deleted from analysis due to a typograph- 
ical error: in the test booklets. 



DEVELOPMENT OF THE PHONICS SUBTESTS 



The winter 1979/80 Phonics test consisted of two sections: a Conso- 
nants subtest and a Vowels Subtest. The two subtests were developed in- 
dependently, although similar guidelines were followed for the development 
of test items and for test format. 

Method 

SUBJECTS 

The four classrooms from Belleville Elementary School participating 
in the study to evaluate the three Structure Subtests also participated 
in the study to evaluate the two Phonics Subtests, A total of 39 second 
grade students and 34 third grade students took both the Consonants and 
Vowels Subtests. 

PROCEDURE 

The Consonants cind the Vowels Subtests were administered the same 
morning. After the Consonants Subtest was administered, the children had 
a half -hour recess, followed by the aciministration of the Vowels Subtest. 
Both subtests were given in January 1980 by staff members from the 
Wisconsin Research and Development Center for Individualized Schooling and 
by specially trained personnel hired the Project. Directions for bot^^^^ 
subtests were read from administrator's manuals. 
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Consonants Subtest 

After the booklets for the Consonants Subtest were distributed and 
the student identification information entered on the cover, the examiner 
explained to the students that they would be listening for consonant 
sounds at the beginning of words. The excuniner then worked with the 
students on four practice items. One practice item represented each of 
the following categories: single-letter consonants with one common sound 
correspondence, single-letter consonants with more than one common sound 
correspondence, consonant clusters, and cbnsbncirit digraphs. 

For each item, students were directed to look at the synthetic word 
in the box arid to proridiance the word silently to themselves. They were 
told to especially note the underlined letter (s) in the word, and to decide 
the sound made by that underlined part. Next, the examiner read the nctmes 
of the four pictures in the row. The students' task was to circle the 
picture \(diose name began with the same sound as the sound made by the 
underlined part of the synthetic word. 

Poiiowing discussion of the four practice items (between 8 and 13 
minutes) , the children were led through the test. The examiner paced the 

children through each test item, saying, "put your finger on Row # ^" 

and "say the made-up word to yourself." The examiner then named the four 
jpictures in the row. This procedure was repeated for each item on the 
test. 

When the Initial Consonants section of the Consonants Subtest was 
completed, the examiner explained to the students that they would now 
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begin listening for consonant sounds at the end of words. The examiner 
worked with students on the three practice items for final consonant 
sounds (using as examples a single-letter consonant with one common sound 
correspondence^ a consoneint cluster, cind a consoneint digraph). At the end 
of the practice period (between 4 and 10 minutes) , the examiner led the 
children through the actual test items naming each picture as before. 
Total test time for both the Initial and Final Consonants sections (in- 
cluding practice items) ranged from 38 to 43 minutes. 

Vowels Subtest 

The Vowels Subtest was administered in the same way as the Consonants 
Subtest, except that students were instructed to listen to vowels sounds 
in the middle of words (51 items) and at the end of words (5 items). 
Practice items were provided for items in both positions. 

Total test time (including practice items) ranged from 27 to 30 minutes 
for both the Medial and Final Vowels sections of the. Vowels Subtest.""*^ 

STIMULI 

Consonants Subtest 

The present version of the Consonants Subtest was designed to assess 
45 different spelling- to-sound correspondences. Sounds selected for 
testing were represented by single-letter consonants, two-letter consonant 
clusters, and two-letter consonant digraphs. The 45 target correspondences 
were assessed in 90 items, as compared with the previous version, which 
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assessed 25 target correspondences in 81 itisms. The revised Consonants 
Siibtest was designed to be more global, assessing almost twice as many 
correspondences as in the previous test. The two tests, however, were 
approximately the same length because two, rather than three or four, items 
were created for each correspondence. It was intended that teachers would 
evaluate children's performance in the present version of the Consonetnts 
Subtest by category (i.e,, single-letter consonants, consonant clusters, 
and consonant digraphs), rather than by individual correspondences, as 
was the case in the previous version of the test. For example, a student 
making errors on correspondences represented by cl-, -nt , -mp, gr- , and 
st~, would be viewed as having difficulty with consonant clusters in 
general, rather than with these five correspondences in particular. 

Of the 90 items comprising the Consonaints Subtest^ 59 items assessed 
spelling- to -sound correspondences of consonants in initial position and 
31 items assessed corresponc' mces in final position. Each item on the 
subtest consisted of a synthetic word with the target letter (s) underlined 
and four response choices in picture form. Students were directed to read 
the synthetic word silently to themselves and to determine the sound 
, represented by the underlined letter (s). Next, they were told to listen 
as the examiner read the names of the four picture response choices for 
that item. Students were then instructed to draw a circle around the 
pictuFe~wHo¥e *naine Segari (or elfided) with the sound repres<^^^^ 
underlined letter (s) in the target synthetic word. Figure 4 is a copy of 
the directions and practice items for consonant correspondences in initial 
position from the Consonants Subtest, 
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PHONieS : Consonants 
Initial Position 

In each row, look at the made-up word. Notice that there is a letter 
or letters underlined at the beginning of that word. Read the word 
to yourself and decide how the underlined letter or letters sound . 
Then listen carefully as I read the names of the pictures in the row 
and decide which picture name begins with the same sound as the 
Underlined letter or letters in the made-up word. Draw a circle 
around that picture. 




Figure 4. Directions and practice items from the first page section of the 
Consonants Subtest for Initial Position. 
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Target consonant sounds for the present test were selected according 
to their frequencies of occurrence in the Venezky (1962, Note 1) tabula- 
tions of the 20,000 most common English words- All single-letter con- 
sonant and two-letter consonant digraph correspondences with frequencies ex- 
ceeding 150, and all two-letter consonant cluster correspondences with frequencies 
exceeding 110 ^ were selected for inclusion in the Consonants Subtest. These 45 
spelling-tb-souhd correspondences each appeared in two one-syllable target syn- 
thetic words that conformed to phonological principles of the English language. 

The response choices for each item were four pictures whose names are 
well known to elementary school children. For each target item, the 
four response choice categories were: a Corr^c^ response choice, a 
Visually Close response choice, an AeousticaXly- Close response choice, 
and a ^'Neither-- (neither acoustically close nor visually close) response 
choice. For the six items assessing the three single-letter consoneuits 
having other common sound correspondences — £, and s_ — the Acoustically 
Close category was changed to be the Other Common Sound Correspondence. 

SELECTION OF TARGET SOUNDS. Spelling-to-sound correspondences for 
consonants can be classified into three major categories: single-letter 
consonants, two-letter consonant clusters^ and consonant digraphs. Of 
the 90 items comprising the Consonants Subtest, 59 items assessed cor- 
respondences in initial position and 31 assessed them in final position. 

According to the Venezky (1962) tabulations, 23 of the 24 single- 
letter consonant correspondences have frequencies exceeding 150 in the 
20,000 most common English words. (The exception is ^ which, when it 
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assumes consonant status in initial position, has a frequency of only 5b; 
because of this low frequency value, ^ is not assessed in the Consonants 
Subtest). Two other single-letter consonants, x and were also not 
assessed in the Consonants Subtest. Although their frequencies exceeded 
150, it was either extremely difficult or iit^ssible to develop items for 
these two correspondences utilizing only one-syllable words. The 21 
single-letter consonants that were selected for inclusion in the Conso- 
nants Subtest, their frequencies of occurrisnce, and the positions in 
which they were assessed are presented in Tcible 13. 

Nineteen two-letter consonant clusters were identified as having 
frequencies of over lib. The 19 different consonant clusters, their 
frequencies of occxirrence and the positions in which they were assessed 
(arranged by manner) are also presented in Table 13; 

Of the seven two-letter consonant digraphs , only five had great 
enough frequencies to warrant inclusion in the Consonants Subtest. 
These five digrapTis, all with frequencies exceeding 150, are: sh, ng, 

(voicelesis) , ofe , and ph. The frequency of occurrence of each digraph, 
as well as the position in which each digraph is assessed, is presented 
in Table 13. 

SEiiECTiON OF 3RESPONSE CHOICES. There were four types of response 
choices for each item: a Correct response choice, a Visually Close 
response choice, an Acoustically Close response choice, and a "Neither" 
(neither acoustically close nor visually close) response choice. For 
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Table 13 



Target Correspondences in Consonants Subtest 
by Frequency and Position 



Example Total frequency Position assessed 



Initial Final 





15 ingle-letter 


consonants 






b 


bat 


1,445 


XX 




c (as /k/) 


cup 


2,433 


XX 




c (as /s/) 


cent 


719 


XX 




d 


ddq 


2,897 


X 


X 


f 


fox 


1 , 064 


X 


X 


2_ (as /g/) 


goat 


722 


X 


X 


2^ (as /j/ with 
silent e) 


cage- 


595 




XX 


h 


house 


764 


XX 




1 


lug 


214 


XX 






kite 


395 


X 


X 


1 


ramp 


3,679 


XX 




m 


ndce 


2,711 


X 


X 


n 


SUflr 


4,599 




XX 


E 


pet 


1,811 


X 


X 


^ (followed by a) 


queen 


192 


XX 






rake 


971 


XX 




s- (as /s/) 


s^ink 


2,171 


X 


X 


£ (as /z/) 


boy£ 


612 




XX 




tag 


4,040 


X 


~ ""X 


V (with silent e 


vest 


1,534 


X 


X 


in final position) 






w 


witch 


442 


XX 





52 
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Table 13 (continued) 



Example 



Total frequency 



Pos it ion ass es sed 



Initial 



Final 



Consonant clusters 



stop -i^ liquid 
br 
£l 
cr 
dr 

IE 

EE 
tr 



broom 

ciip 

crown 

drxam 

grapes 

plug 

prince 

train 



232 
184 
241 
135 
275 
175 
549 
401 



XX 
XX 
XX 
XX 
XX 
XX 
XX 
XX 



liquid.-;!^ st<>p 
It 



belt 



155 



XX 



frXcative 4- liquidr 

fr 

si 



flag 
frog 
sled 



160 
125 
114 



XX 
XX 

XX 



nasal 4- stop 
mp 
nd 
nt 



lamp 
hand 
tent 



274 
626 
1,304 



XX 
XX 
XX 



nasal + fricative 

nc (followed by 
silent e) 



fence 



506 



XX 



53 
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Table 13 (continued) 







Example Total frequency 


Position 


assessed 








- 


Initial 


Final 






Consonant 


clusters 


- 





fricative + stop 












se 




scale 


162 


XX 




sp 




spool 


•5 O C 


XX 




St 







stamp 


1,054 


X 


X 








Consonant 


digraphs 






ch 




ehair 


270 


XX 




ng 




swing 


401 




XX 






phone 


188 


X 


X 


sh 




ship 


427 


X 


X 












th (voiceless) 




wreath 


329 


X 


X 
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the six items assessing the three single-letter consonants having other 
common sound correspondences — c_, g-, and s_ — the Acoustically Close cate- 
gory was again replaced with a response using these Other Common Sound 
Correspondences , 

Correct Response Choice . This response choice is a picture whose 
name contains an initial or final consonant sound identical to the sound 
corresponding to the underlined letter (s) in the target synthetic word. 

Visually Close Response Choice . This response choice is a picture 
whose name contains an initial or final letter (or cluster or digraph) that 
is visually close (but not identical) to the underlined letter (s) in the 
target synthetic word. Data from Bouma's (1971) confusion matrix for 

lower case letters were used to create the Visually Close response 

4 - _ _ 

choices. For example, the Bouma matrix shows that b is most often con- 
fused as the lower case letter h_. Therefore a picture whose name begins 
with h_ would be used as the visual distractor for an item assessing 
initial consonant fa. 

For many of the items across all three consonants categories, the 
confusions listed in the Bouma matrix were not used. In these cases, 
distinctive features information derived from Bouma (1971) formed the 
basis for selecting a Visually Close response choice. Bouma's distinc- 
tive features analysis takes into account the height of the letters 



The_Bouma study reported confusions made for 25 of the 26 lower 
case letters when presented on a screen in IBM Courier 10 typeface, 
seven degrees from the point of fixation at a distance of 50 centimeters. 
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(short letters^ ascenders, and descenders), and the width and contour of 
the letters (slender letters, rectangular envelopes, round envelopes, and 
triangular envelopes) . Letters sharing the same properties are considered 
to be visually similar. 

The Bbuma confusion matrix and distinctive features information was 
hot applicable for two-letter consonant clusters and consonant digraphs. 
For these correspondences, the Visually Close response choice was a picture 
whose name began (or ended) with only one of the two letters of the cluster 
or digraph. This foil could differentiate iDetween children who attend to 
the complete cluster or digraph (two letters) and those who attend to only 
a portion (one letter) of the cluster or digraph. in an item assessing the 
digraph ph in final position, for example, the Visually Close reponse 
choice was a picture of a map , because map ends with p, one of tiae two 
letters of the digraph ph. It should be noted that because the Visually 
CiOiiC reponse choice for clusters contains one of the two letters of the 
cluster, this response choice is also acoustically close to the target 
cluster. 

Acoustically Close Respoftse -Choice . This response choice, used for 
all the consonant correspondences except the three single-letter consonants 
which have two common sound correspondences , is a picture whose name con- 
tains an initial or final consonant whose sound is close, but not identi- 
cal, to the sound of the underlined letter (s) in the target synthetic 
word. Whenever feasible, data from the Miller and Nicely (1955) confusion 
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matrices were Used for selecting an acoustic^liy ^^d§& sound for siJ^9i^-: 
letter consonant iternis. ^ For example, the M^lJe^ ^icely matric'^s 
dicate that /b/ is most often confused as ei-th^^^ /f/. TherefoJr^^ 

a picture whose name begins with /v/ or /f/ ini^^i ^ as^^ as the ac<^^st:ic 
distractor for an item assessing the initial con^^^^eixyi- 

The Miller and Nicely information was n^t u^^^m scxne of ti^^ 

single-letter consonants or for any of the cQji^on^t clusters or con" 
sonant digraphs. The Acoustically Close resj^fise ^h^ic^ for those ^irigj^e- 
letter consonants for which Miller and Nicely d^t^^ coul<j not be use3 
based upon speech data describing where the vsJ^i-o^^ consonant sound^ ^Jre 
produced within the vocal tract. Two sounds p^od^^^^^d proximal lo^i 
within the vocal tract are perceptually cIosq^ th^^ tv^o gounds produce^ 
farther away from each other. Acoustically Q3,c7Se -^^sp^tise choices 
some single-letter consonants and for all of tJ^e '^^^ison^t digraphs ^^Jre 
formulated on the basis of this production -pe^<?^P*''^^n itiformation. ^°Jr 
example, the selection of ah Acoustically Clo^e r^^^^brJS^ choice in 
initial position for /d^/ (as in -j^-r) was accc?it*Pi^^^^d: hy identifying ^ 
sound produced in a proximal locus within the voc^^ ti^^^t to where /^J/ 
is produced. The sound /t^/ (as in chair) fuifiiJ-^ tJ:iis requirement 
therefore a picture of a chair could be an AcoUSti-^^ijy s^se respon^^ 
choice . 



The Miller and Nicely study presented p^r^ej^t^v^^j Q^^ fusions fo^ 
16 consonant singletons under the manipulated v^^^i^i^s of signal to 
noise ratio, decibel level, and frequency res^r^se c^Qj^es per sec^^^^^. 
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A separate set of decision rules determined the Acoustically Close 
response choices for consonant clusters- Acoustically Close response 
choices for clusters were developed by changing the place (i.e. , front 
to back in the vocal tract), but retaining the manner (e.g., stop, liquid, 
fricative) of one of the two letters of the cluster. For example, an 
Acoustically Close response choice for the target cluster /gr/ could be 
/dr/ or /br/ (the /g/ is changed to another voiced stop, but the liquid 
/r/, or even /gl/, is retained). Table 14 lists the types of changes 
made in target consonant clusters for the Acoustically Close response 
category. For the three single-letter consonemts which have two common 
sound corvespondences (£, £, and s) , the Acoustically Close response 
choice was replaced by a new categoiry, the Other Common Sound Correspon- 
dence. Responses in this category were pictures whose names began or 
ended with the second most frequently occurring sound correspondence for 
the target single-letter consonant \c_ as /s/, g as /j/, and s_ as /z/) . 

"Neither** Response Choice . This response choice is a picture whose 
name has neither a sound that is acoustically close, nor a letter that is 
visually close, to the underlined part of the target synthetic word. For 
example > in an item assessing the single-letter consonant h in the target 
synthetic word hurp , the **Neither** response choice was a picture of a sock . 
The sound /s/ in sock is neither acoustically close to the /h/ in hurp , nor 
is the letter s- visually close to the letter h-. For consonant clusters and 
cdnsbncuit digraphs, the **Neither** response choice began or ended with a two 
letter consonant cluster that was neither acoustically close to the sound, 




Table 14 



Categories for Detenmiing ftcousticaliy Close 
Response Choices for Consonant Clusters 



Consonant Clusters 



Initial Final 



Change to 
another 
stop 



Keep 
liquid 



Keep stop 



Change to 
another 
liquid 



Change to 
another 
liquid 



Change to 
another 
stop 



Change to 
another 
fricative 



Keep 
fricative 



Change to 
another 
nasal 



Keep 
nasal 



Keep 
nasal 



Keep 
fricative 



Keep 
liquid 



Change to 
another 
liquid 



Change to 
another 
stop 



Change 
stop 



voiceless 
fricative 
to voice 
fricative 



Change to 
another 
stop 



stop f liquid 

br- 

ci- 
cr- 
dr- 

gr- 

Pi- 
pr- 
tr- 



-it 

fricative + liquid 

fi- 
fr- 
sl- 

nasal-i-stop 

-hd 

lit 

nasal -i-^rjcative- 
-nce 



fricative + stop 



sc- 
sp- 

st" 



gr, dr 
pi 

gr, br 
dr, br 

cl (Al/) 
cr (/kr/), tr 
pr, or (Ar/) 
Ik 



cr 
cl 



pr 



rk 



si 
thr 
fl (2) 



fr 

fi 



nt, nk 
nk 



nt 

nk, nd 



nz 



Si 

si 



-St 



6 



sp, St 
t (2) 
p, sc 
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nor visually close to tho lot tors o\' tlu* tafqot i'oi1:;vM\ant i'Iu:;(im 
digraph. The Neither category was created to see whether children, when 
they were unsure of a correct answer, would be strategic and tend to select 
either an Acousticatly^ros^e'oP^ Visually Close response, or whether they 
would merely guess at the correct answer randomly selecting from among all 
three incorrect response choices. If error analyses of individual children' 
performance revealed as many responses in the Neither category as in the 
Acoustically Close and Visually Close categories, these children would be 
using random rather t±ian strategic selection processes. 

Vowe ls Subtes t 

The new version of the Vowels Subtest was designed to assess 28 dif- 
ferent spelling -to -sound corresppndences. Sounds selected for testing 
included the five short and five long vowels, four other frequently occur- 
ring single-letter vowels (i.e,^ single-letter vowels that correspond to 
sounds that are neither short nor long), and 14 two-letter vowel clusters. 
The 28 spelling-to-sound correspondences were assessed in 56 items, as 
compared with the previous version of the test, which assessed 20 different 
correspondences in 60 items. The revised test was designed to be moire 
global, assessing 40% more correspondences in a test of approximately the 
same length. This was accomplished by creating two, rather than three, 
items for each correspondence. As with the Consonants Subtest, it was 
intended that teachers would analyze children's performance by category 
(short vowels, long vowels, other single-letter vowels, and two-letter 
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vowel clusters)^ rather than by individual correspondences. For example > 
a student making errors on correspondences represented by ou, ai , oo , and 
ow would be viewed as having difficulty with vowel clusters in general^ 
rather than with these four correspondences in particular. 

Each of the 56 items on the Vowels Subtest consisted of a synthetic 
word with the target letter (s) underlined, and four response choices in 
picture form. Students were directed to read the synthetic word silently 
to themselves and to determine the soimd represented by the underlined 
letter (s). Next, they were told to listen as the examiner read the names 
of the four picture response choices for that item. Students were then 
instructed to draw a circle around the picture whose name contained the 
same medial (or final) vowel sound as the sound of the underlined letter (s) 
in the target synthetic word. Figure 5 is a copy of the directions and 
practice items from the Medial Vowels section of the Vowels Subtest. 

Target vowel sounds were selected according to their frequencies of 
occurrence in the Venezky (1962) corpus of the 20,000 most common English 
words. The frequency ranges for the vowels selected for inclusion in the 
test, by category, were: short vowels = 7554 to 1458; long vowels = 1870 
to 503? other single-letter vowels = 243 to 117; and two-letter vowel 
clusters = 72 3 to 12 3.^ Each spelling-to-sound correspondence selected 



The frequency value of 723 represents the summed frequencies of 333 
for o£ (as in porch) and 390 for or (as in com ) . Although Venezky dif- 
ferentiates between the two correspondences, they are regarded as one 
correspondence in the present study. 



o B2 
ERIC 
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PHbNieS: Vowels 
Medial Position 



In each row, look at the made-up word. Notice that there is a letter 
or letters underlined in the middle of that word. Read the word to 
yourself and decide how that letter or letters sound. Then listen 
carefully as I read the names of the pictiares in the row and decide 
which picture name contains the sound of the underlined letter or 
letters in the made-up word. Draw a circle around that picture. 




Figure 5. Directions and practice items from the first page of the 
Vowels Subtest for Medial Position. 
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appeared in two one-syiiabie target synthetic words that conformed to 
phonological principles of the English language; 

The response choices for each item were four pictures whose names 
are well known to elementary school children. For each target item, the 
four response choice categories were: a Correct choice, an Acoustically 
Close response choice^ a Visually Close response choice, and a Neither 
(neither acoustically close nor visually close) response choice. 

Of the 56 items in the Vowels Subtest, 51 items assessed vowels in 
medial position in words, and 5 items assessed vowels in final position. 
Ail 51 of the items testing vowel sounds in medial position used one- 
syllabie target synthetic words and one-syllable picture riamiss which con- 
formed to a eve (or CCVC) pattern. Because the final consonant sound in 
a CVC (or CCVC) word affects the duration of the medial vowel (and, in 51 
of the Vowels Subtest items, the medial vowel was the sound of interest), 
either voiced or all voiceless final consonants were used for the final 
consonant sounds for the target synthetic word and the four response picture 
names within an item. This control provided soma dc.:^c of consistency 
for medial vowel duration within items. 

SELECTION OP TARGET SOUNDS. The correspondGncss ^^^^^esi^.^l 1: the Vowels 
Subtest can be grouped into four categories: short vcvtvl.. , long V-^^wels, 
other common correspondences for single-letter vowels, ary j twc—lett^^r 
vowel clusters. 

The five singie-letter vowels corresponding to short vow ^. rounds, 
were selected for testing. According to Venezky (19G2) , tne five short 
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vowel sounds--short ^ (as in bat ) , short e (as in peg ) , short i (as in 
lid ) , short jo (as in shot ) , and short u (as in duck ) - — have letter-to- 
souhd correspondences with frequencies exceeding ISO, All five short 
vowel sounds are designated as simple vowels- The frequencies of 
occurrence of each short vowel sound and the position (s) within words 
in which each vowel is assessed are presented in Table 15. 

All five single -letter vowels corresponding to long vowel sounds 
were selected for testing. The Venezky (1962) tabulations indicate that 
the five long vowel sounds — long a (as in cape ) , long e_ (as in mete ) , long 
X (as in hide) \ long o (as in bone ) , and long u, (as in flute ) ^ — all have 
speiling-to-sound correspondences with frequencies exceeding 150. Accord- 
ing to Kenyon and Knott's (1953) "A Pronouncing Dictionary of American 
English** (the source used by Venezky for the pronunciations of the 20,000 
most common English words) , long e^ cind long u are always designated as 
simple vowels, whereas long ^ is always designated as a diphthong. In 
this study, both long _a aind long _o^ were considered diphthongs because 
the vowel sounds in CVC trigrams are more commonly pronounced as diphthongs 
than as simple vowels. In this study/ all target synthetic words and 



While the sound of ja in fuse (the c^iphthonq ju or iu) has a greater 
frequency than the sound of u Ir. .r lute ftl>,e simple^, vowel u) , only the 
latter letter-sound correspondent, was ,vsod in the Vowels Subtest. This 
is because there are few ohe-sylla'* le i:s.ct.urable words with ii as ia fuje 
that are well-kho\7n to elementary -'^hool f wcils. Except for when tr.v- 
sound correspondence for the letter \ orjcuryv in initial position, the two 
sound correspondences above for ii are con£i-dered very ^^imilar. 
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Table 15 

Target Correspondences for Short, liOng, and "Other" 
Single-letter Vowels by Frequency and Position 



Example 



Total frequency 



Position assessed 



Medial 



Final 



Short vowels 
a 

i 
o 
a 



hat 

dress 

fish 

mop 

drum 



3,121 
3,241 
7,554 
1,590 
1,458 



XX 
XX 
XX 
XX 
XX 



Long vowels 



a 
e 

o 



r^e 
me^te 
hive 
irope 
flute 



1,870 
503 
968 

1,292 
967 



XX 
XX 
XX 
XX 
XX 



other single- 
letter vowels 



a^ 
b 



y (sometimes 
followed by 
silent e) 



ball 

glove 

dog 



147 
159 
117 

243 



XX 
XX 

XX 



XX 



See Footnote 7. 
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picture names of response choices used in assessing vowei soiinds in medial 
position are eve (or ecVC) trigrams; The frequency of occurrence of each 
long vowei sound and the position in which each vowel is assessed are pre- 
sented in Table 15. 

Four other single -letter vowel soxinds which did hot correspond to 
either short or long vowel sounds were assessed in the revised Vowels Sub- 
test. All four of these correspondences had frequencies exceeding 115 in 
the Venezky (1962) corpus and appeared in words well Jchown to elementary 
school age children. Three of these correspondences have sounds designated 
as simple vowels: (as in walk ) , _o (as in glove ) , eind o_ (as in dog ) . The 
fourth correspondence, _y (as in type ) , has the sound of long i, and was 
thus designated as a diphthong. The frequency of occurrence for these 
four other single-letter vowel sounds and the position within words in 
which each correspondence is assessed are presented in Table 15. 

The revised version of the Vow ^ Subtest assesses 14 two-letter 

vowel cluster correspondences, as compared to the previous version, which 

assessed only 10 of the vowel clusters. The additional clusters included 

for assessment were four of five possible vowel + r correspondences: ar 

8 

(as in barn) , er (as in herd ) , or (as in porch , and as in corn ) -, and ur 

9 _ - _ _ - 

(as in nurse) . (Because ir [as in bird] -, which is the fifth vowel + r 



Venezky (1962) differentiates between the or in porch and the or in 
corn. In this paper, the two correspondences will be treated as one. 

9 - - _ 

In this subtest/ all vo wel + r combinations are treated as vowel 

clusters. The authors are aware, however, that er and Uf are simple 

vowels, whereas ar and or^ are vdwal 4-- r^ combinations. 
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correspondence > had a frequency of only 106, it was not selected for in- 
clusion in the Vowels Subtest.) Table 16 presents the frequency of oc- 
currence for each of the 14 vowel clusters and the position in which 
each cluster is assessed. 

SELECTION OF RESPONSE CHOICES. As in the Consonants Subtest, there 
were four categories of response choices for each item: a Correct re- 
sponse choice, a Visually Close response choice, an Acoustically Close 
response choice, and a Neither (neither acoustically close nor visually 
close) response choice. 

Correct. Response Choice . This response choice is a picture whose 
ncune contains a medial or final vowel sound identical to the sound repre- 
sented by the underlined letter (sj in the target synthetic word. 

Visually Close Response Choice . This response choice is a picture 
whose name contains a medial or final letter (or letters) that is either 
visually close or identical to the imderlined letter (s) in the target 
synthetic word. Because the Bouma (1971) study indicated that all lower 
case vowels are visually similar (except for lower case i) , confusion 
matrix information was hot as useful in creating Visually Close response 
choices for the Vowels Subtest as it had been for the Consonants Subtest. 
Therefore, a new set of decision rules was created for this response 
category. 

For the two-letter vowel clusters, the Visually Close response choice 
either contained one of the two letters of the cluster (e.g., for the ou 
cluster in proun , the Visually Close response choice was knob — only the 
£ of the ou_ cluster was retained), or kept one letter constant, but changed 
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Table 16 

Target Correspondences for Vowel 
Clusters by Frequency and Position 



Example 



Total frequency 



Position assessed 



Medial 



Final 



Vowel clusters 

ai 
ag 
ar 

ea 
ea 
ee 

©a 

. b 

oil 

QW 

pw; 
ur 



traxn 

taut 

bam 

play 

seal 

bread 

feet 

fe^rn 

inoor. 

porch 

cloud 

gown 

snow 

purse 



See FcotT'Ote 9. 
"'^'.e FooxXiOte 8. 



261 
175 
532 
142 
320 
135 
294 
387 
198 
723 
238 
123 
130 
204 



5CX 
XX 
XX 

XX 
XX 
XX 
XX 
XX 
XX 
XX 
XX 
X 
XX 



XX 
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the other letter of the cluster (e^g., for the ay in chay, the Visually 
Close response choice was saw— the a was retained in the spelling, but 
the was changed to a ^) . 

The Visually Close response cat -gory was renamed Other Frequent 
Soiind Correspondence for the items .ssessing all short, all long, and the 
four other frequent correspondences for single-letter vowels. For the 
long and short vowel correspondences, the Other Frequent Sound Correspon- 
dence consisted of the long vowel counterpart for the short vowel, or the 
short vowel counterpart for the long vowel ."^^ For exait^le^ for the syn- 
thetic word Chun , with the target short u (as in drum) , the response 
choice in the Other Frequent Sound Corresponaence category was tube — a 
word containing the vowel sound of long u. 

For the four other single-letter vowel correspondences (which were 
neither short nor long) , the response choice for the Other Frequent Sound 
Correspondence was developed in a similar way. Here the response choice 
consisted of a picture whose name contained the same vowel spelling, but 
with a different sound correspondence from the vowel in the target syn- 
thetic word. For example, for the correspondence of o as /a/ (as in dog ) , 
the picture representing the Other Frequent Sound Correspondence was cob 
and the correct answer was saws . Although the target vowel in the synthet 



The only exception is for the target vowel, long e. Because the 
short ^ vowel sound is acoustically close to the sound corresponding to 
^^^9:2.' the Other Frequent Sound Correspondence category had picture 
names containing the letter J, buc which sounded like neither short ^ 
nor long _e (e.g., tdas cind shoes ) . 
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word is always a single-letter vowel, the vowex ^o^^ in t:he Other Ft^" 
quent Sound Correspondence may be spelled with eitJ^^^ o two lett^^^ 

(as with /u/ in tube or suit). In either case^ ^^ov/^l used in the 

target synthetic word is included in the spelling tn^ picture name 
in the response choice in the Other Frequent S^u^^^ ^^Irjce^^ndence caX.^^^x^^ , 

(This inclusion of the same vowel causes the i^e^^s other Frequ^^t: 

Sound Correspondence category to be Visually Cio^^ v/^il.) 

Acoustically Close Response Choice , This ^^Hoice is a p^^t^re 

whose name contains a medial or finial vowel sb^n^ "t^^t SQ^j^ds simiiar ^^Ut 
is not identical to the sound cd:rr-jsp;>nuiiig vo t^J^e ^Me^^ttried letter (^) 
in the target synthetic word. For s.l >Qle-iettex: vo^%x^ two-tetteJ^ 
vowel clusters corresponding to simr^-- vowel s^xjP-^^' A^t^^ iram the Pe^^^son 
and Barney (1952) confusion matrix were used to ^=^^^^6 'tH^ /tcoustical^y 
Close response choice. For example, the Pet^ir^o^ ^^rney matrix 

indicated that /ae/ (as in hat ) is most often ^o^^fiJ^^ca /£/ (as in 
neck) . 

The Peterson and Barney information was not u't^i.i^eq^ however, wi^^n 
single-letter vowels and two-letter vowel clust^e^s ^^irjr^^^nded to diphthongs. 
Acoustically Close response choices for the eigh^ <^^^htJ^^rtg correspondences "^^ 



- The Peterson and Barney study _reported_^a^i'i^^^V ^Ot^fusions by.^^Ult 
observers under an approximately 70 decibel leye^ i 9 simple vowel 

sounds, each presented 152 times by men, women, ^hi^^lren specJcers* 

The eight diphthong correspondences are. ^^^^ 
ai (as in wait ) , a£ (as in pay ) , ou (as in hou^ e) > 25f (a^; govjn) an^ §Vj 
(as in bowl ) . 

7i 
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were based upon speech data which describes where the various diphthong 
sounds are produced within the vocal tract. As with acoustically close 
consonant sounds, it is known that vowel sounds produced in proximal loci 
within the vocal tract aire percept-ually closer than sounds produced in 
more distal loci. For excUtiple, the vowel cluster ou, which corresponds 
to the diphthong /axV (as in house ) , is produced from a low-central /a/ 
to a lower-high back /ir/ position in the vocal tract. An acoustically 
close vowel sound could be /V/ (as in pawn ) , which is produced in the 

higher low-back position in the vocal tract — quite close to where the 

- - - 13 

/avy is produced. 

"Neither" Response Choice . This response choice is a picture whose 

name has neither a sound that is acoustically close, nor a letter that 

is visually close, to the underlined part of the target synthetic word. 

For excunple, in an item assessing the medial vowel for short o_ (as dLn the 

target synthetic word> stom ) $ wig was used as the Neither response choice 

because the medial vowel i^ in wig neither sounds like nor looks like t.- e 

9_ in stom. 

As in the Consonants Subtest, the Neither response category was 
created to see whether a child who did hot choose the correct response 
choice would be strategic and tend to choore either an Acoustically Close 



The terms and locations of the positions within the vocal tract 
for these vowel sounds are taken from Kenyon and Knott, " A Pronouncing 
Dictionary of American English, " 1953^ p* xiii. 
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or a visually Close response choice- or, would merely guess at the correct 
answer, and randomly select from among the three incorrect response choices. 



Summary statistics for the 73 second and third grade students on 
the Phonics Subtests (Consonants and Vowels) are presented in Table 17. 
Overall, performance on the Consonants Subtest was high (mecin percent cor- 
rect, 91.22} indicating that by the second and third grades, most children 
have mastered a majority of the letter-soimd correspondences assessed by 
the Consonants S\ihtest. 

Performance on the Vowels Subtest was considerably lower (mean per- 
c€int correct > 70.52). The lower pertc '•mance on the Vowels Subtest was 
exjpected due to the greater variability of sounds corresponding to each 
vowel letter. Students' performance on the two Phonics Subtests was also 
examined ]by item category. This information, as well as reliability es- 
timates for each subtest, is presented below. 

coNSON^mrs subtest 

Of the 90 items on the Consonants Subtest > students obtained a mecin 
score of 82.09 (91.22%) correct. In order to identify items on which 
students performed poorly and to obtain an estimate of the reliability 



of the Consoncints Subtest, the raw score data were subjected to an item 
analysis. The resultant Hoyt reliability estimate for the Subtest was 
.79, with a standard error of measurement of 2.11. 



Results 
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Table 17 

Sununary Statistics for Phonics Subtests 



X 

percent 
correct 



Range of 90 items 
(percent correct) 



Corisbncmts 
Grade 2 
Grade 3 

Total 



39 
34 
73 



89.91 
93.10 
91.22 



74 - 98 
87 - 99 
74 - 99 



Vowel s 
Grade 2 
Grade: 3 

Total 



39 
34 
73 



66.12 
75.94 
70.53 



3b - 96 
39 - 96 
30 - 96 



?4 
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A rank-ordered listing of performance on the foar categories of 
correspondences assessed in the Consonants Subtest is presented in Table 18. 
Performance on these categories ranged from 97.54 mean percent correct on 
single-letter consonants with one common sound correspondence to 61.54 mean 
percent correct on variant single-letter consonants. This finding repli- 
cates the finding in the previous study: children perform best on single- 
letter consonants which have one common sound correspondence, and least 
well on variant single-letter consonants (those having mors than one 
common sound correspondence) . 

VOWELS SUBTEST 

On the 56 items in the Vowels Subtest, students obtained a mean 
score of 39.49 (70.52%) correct. In order to identify items on which 
students performed poorly and to oiDtaxn an estimate of the reliability of 
the Vowels Subtest, the raw score data were subjected to an item analysis. 
The resultant Hoyt relia^-tiity estimate for the Subtest was .89 with a 
standard error of measurement of 2.94. 

A rank-ordered listing of performance on the four categories of 
vowel corresiondences is presented in Table 19. Performance ranged from 
a high of 79.62 mean percent correct on Vowel Clusters to a low of 48,63 
mean percent correct on items assessing other single-letter vowels (vowels 
that were neither short nor long). These results are consistent with the 
findings from the previous study: children perform best on vowel clusters 
cvnd least well on single-letter vowels that are neither short nor long. 
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Table 18 

Rank-ordered Listing of Mean Percent Correct Scores 
by Consonant Category 



Category 


Ninnber of items 


Mean percent correct 


Single-letter consonants^ 


29 


97.54 


Consonant clusters 


40 


95,34 


Consonant digraphs 


10 


89.05 


Variant single-letter ^ 
consonants (c, s, and 


11 


61.54 



Single -letter c orison ants with one cbinmon sound correspondence. 



Si 

pondence 



Single-letter consonants with more than one common sound corres- 



76 



ERIC 
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Table 19 

Rank-ordered Listing of Mean Percent Correct Scores 

by Vowel Category 



Category 


Number of items 


Mean percent correct 


Long vowels 


11 


66.76 


Short vowels 


11 


74.34 


Other single-letter vowels^ 


Id 


^ .63 


Vowel clusters 


. 24 


79.62 









"Single-letter vowels that are neither short nor long. 
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PREPARATiON OF THE PINAL VERSION OP THE 
WORD IDENTIFICATION TEST BATTERY 

There were two main purposes of the winter 79/80 administration of 
the Structure and Phonics components of the Word Identification Test 
battery. The first was to evaluate each subtest prior to preparation of 
the final versions of the subtests. Overall, only minor changes were 
made on the subtests; these changes are documented below. The second 
purpose was to evaluate the grade-level appropriateness of each subtest. 
The Affixes and the Contractions fi Possessives Subtests, for example, 
were fouiid too difficult for second grade students, but appropriate for 
third grade students. The Phonics Subtests and the inflected Endings Sub- 
test appeared to be appropriate for both second and third grade students. 

Strocture Subtests^ 

INFLECTED ENDINGS SUBTEST 

Item analyses indicated that performance on all test items was satis- 
factory. As part of the analyses, items were grouped by inflected ending 
category and a mean score for each category was calculated. iteSs within 
a category were scrutinized for discrepant performance. The only nBtabie 
dif f... rences in performance were on those items within a category where 
"none of these" was the correct response. As a result of the analysis of 
items by category, however, a decision was made to increase the number of 
items assessing the "y" ending from one to two items, and to reduce the 
number of items in which the correct response was a root word (from 11 to 10) 
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in addition, minor word changes were made in i;:em isteins <or 3 cv" the 
39 items as a result of second grade students' difficulcy in ^rl 
certain words during the actual Cidministration of the subtest. 

CONTRACTIONS & POSSESSIVES SUBTEST 

In order to evaluate test items in this subtest, the items were 
divided into two groups: con', rj- t ions and possessives. Scores within 
each group were examined, and items on which performance was significantly 
lower than the mean score for the item group were identified. As a result 
of this procedure, two contraction items and two possessive items were re- 
vised. 

Items with a correct response of "none of these" were analyzed 
separately to see if performance was generally poorer oh these items. 
AS in the Inflected Biddings Subtest, performance by contraction category 
was generally poorer on these items. The correct response choice for 
two of the items was changed to "none of these," and two of the items 
where "none of these" was formerly the correct response were altered so 
that the actual correct response was presented. In this way, performance 
could be compared when "hone of these" was the correct response to when 
it was not the correct response in the spring 1980 administration of the 
testi Also, the correct response choice for one possessive item was 
changed to "none of these." Formerly, there were no possessives items 
with a correct response of "none of these." 

A final change affected the ordering of the items within the sub- 
test. Those items assessing the possessive apostrophe were dispersed 
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throughout the test, racher than grouped together at the beginning of 
the test as they had been in the previous version. 

AFFIXES SUBTEST 

Mean scores on items within each affix category were exconined, and 
scores on items within a single category which varied considerably from 
scores on other items within that same category were identified. As part 
of this process, each response choice was reviewed for its likelihood of 
being selected. For three items, an incorrect response choice appeared 
to be easily confused with the cdrrisct response. In these three items, 
a new response choice replaced the confusing foil. For all test items, 
familiarity level of each correct response was checked in Tha Jiiving^^Wbrdr 
Voc abu lary for grade level appropriateness. If there was low performance 
on an item, and if the grade level familiarity rating of the response 
word was too high, the item was revised. As a result of this procedure, 
8 of the 53 target words were modified. 

Another issue that was investigated was whether the inclusion of a 
synonym for the root word within the item stem affected children's per- 
formance. A comparison of items with eind without synonyms din the stems 
revealed no discrepeincies in performance between the two groups. 



CONSONANTS SUBTEST 

Minor revisions were made in approximately 16% of the items ixi the 
preparation of the final Consonants Subtest: Three of the 59 items were 
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changed in this Initial Cdrisdnarits section, and 11 of the 31 items were 
revised in the Final Corisohahts section. A practice item was eliminated 
from each section, which reduced the number of practice items to three 
for Initial Consonants and two for Final Consonants. 

All revisions were minor; there were no items in which the target 
synthetic word and all four response choices were completely altered. 
Most of the revisions were made for one of the following three reasons: 

1. More than one response choice within an item had the same 
medial vowel sound. New words were substituted which had the same con- 
sonant sounds in the position of interest (initial or final) , but which 
had different medial vowel sounds. 

2. Two of the incorrect response choices ended with the Scime con- 
sonant sound in the position of interest. One of those two response 
choices was changed to a new word ending with a different consonant 
sound. 

3. ; ' i from previous versions of the Consonants Subtest 
showed tYiLt for consonant cluster and consonant digraph items, students 
often incorrectly selected the response choice that contained only one 
of the two letters of the cluster or digraph, especially when this foil 
choice appeared before the correct response choice. Therefore, response 
choices within some of thcj cluster and digraph items were reordered so 
that such foils and the correct response choice would appear first- with 
equal frequency. 
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VOWELS SUBTEST 

Minor revisions were made in approximately 13% of the items in 
preparation of the final Vowels Subtest: Five of the 51 items were re- 
vised in the Medial Vowels section, and two of the five items were modi- 
fied in the Final Vowels section. As in the Consonants Subtest, all re- 
visions consisted of only partial changes; no items were completely 
altered. Revisions on medial position items were made for one of the 
following two reasons: 

1. Results from previous versions of the Vowels Subtest indicated 
that when students made errors ^ they tended to select foils containing 
another frequent sound of the target vowel (e.g., in an item assessing 
the soxind of long a_, students who made errors most often selected the 
response choice containing the sound of short a_) . Students were especially 
likely to make an error when this foil appeared before the correct response 
choice. Therefore, response choices within some items were reordered so 
that such foils cind the correct response choice would appear first with 
equal frequency. 

2. Sometimes a response choice that was intended to be acoustically 
close, was actually both acoustically close and visually close. Whenever 
possible, the response choice was changed so that it would be acoustically 
close only. 

. The two revisions made on items assessing vowel sounds in final posi- 
tion involved altering the target synthetic words. The target synthetic 
words were changed so that the initial consonant soxand in the synthetic 
word would be different from the initial consonant soxands in any of the 
response choices. 




CONCLUSIONS 



The primary purpose of this study was to obtain item analysis in- 



formation for use in the preparation of the subtests for the final ad- 



ministration of the Word identification Test battery, to be conducted in 
spring 1980. While only minor revisions were necessary, these revisions 
should improve che diagnostic precision of the tests and eliminate concerns 
regarding correct response position and frequency of occurrence of specific 
distractor categories. 

Oh the whole/ the revisions described above will result in a Word 
Identification Test battery which is short and easy to administer, but 
which has sufficient scope so as to enable educators to make accurate 
diagnostic decisions about the apportionment of time for instruction oi 
the various word identification skills. The revised Structure Subtests 
require students to make use of context in order to establish the mean- 
ings of frequently occurring elements in meaningful text. The format of 
the Structure Subtests is particularly suitable for teaching and assessing 
word identification skills in an integrated manner. The revised Phonics 
Subtests should enable teachers to identify specific areas of strength 
and weakness in children's knowledge of letter sound correspondences. 

Another purpose of the present study was to evaluate the grade level 
appropriateness of each suJDtest. Some of the revisions made in Structure 
Subtest items eliminated words in the item stems v^ich had caused children 
difficulty. Results indicated that (a) the J^onics subtests could be 
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administered to younger childiren (first grade) ^ and (b) the Structure 
Subtests could be administered to older childi.on (fburi-.h and fifth graders 
for Affixes, and fourth graders for Possessives ^ Contractions)- 

In spring 1980, the final Word Identification Test battery and the 
Reading Subtest of the Metropolitan Achievement Tests were administered 
to approximately 100 children in each of grades one through five. The 
data will be used to examine correlations between word identification 
skills, as measured by the various word identification subtests, and 
global coiupreheiision ability, as measured by a standardized test of read- 
ing comprehension. In addition, levels of skills mastery for each of the 
five subskills assessed in the battery will be established. The results 
of this study will be pr ited in a final report to be available in fall 
1980. This final report will mark the conclusion of the research conducted 
over the past three and a half years by the Project on the Assessment and 
Analysis of Word identification Skills in Reading (SIGH) . 
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